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Abstract 

This paper investigates the problem of maximizing expected terminal utility in a (gener- 
ically incomplete) discrete-time financial market model with finite time horizon. In contrast 
to the standard setting, a possibly non-concave utility function U is considered, with domain 
of definition R. Simple conditions are presented which guarantee the existence of an opti- 
mal strategy for the problem. In particular, the asymptotic elasticity of U plays a decisive 
role: existence can be shown when it is strictly greater at — oo than at +00. 

1 Introduction 

The problem of maximizing expected utility is one of the most significant issues in mathe- 
matical fin a nce . To our knowledge, the first studies can be attributed to Merton 1 1969] and 



SamuelsonI il969h . In mathematical terms, EU{X) needs to be maximized in X, where U is 



a concave increasing function and X runs over values of admissible portfolios. For general 
existence results, we re fer to Rasonyi and Stettner 1 2005] in a discrete time setting and to 



Kramkov a nd Schachermaver 1 1999 i] and iSc hachermaver 12001] in continuous time models. 



see also'Biagini an d Frittellii Ii2008] . l0wen and Zitkovid Ii2009i] and the references therein for 
later developments 

Des pite i ts ongoing success, the expect e d ut ility paradigm has been contested (see e.g. 



Ue s pite I ts ongoing success, tne expect e d ut ility paradigm nas been contested (see e.g. 
Allais il953ll and Kah neman and Tverskvl il97^] ). In particular, Tver skv and Kahneman 



1 199211 suggested, based on experimental evidence, that the utility function should not be 
concave but rather "S'-shaped" (i.e. U{x) = U+{x), x > 0; U{x) = -U-{-x), x < Q where 
U± : R+ —5- K are concave and increasing). 

In this article we propose to consider a general non-concave utility function defined on the 
real line (that can be "5-shaped" but our results can be applied to a broader class of utility 
functions). As the objective function is non-concave, the mathematical treatment becomes 
diffic ult and only few related re sults can be found in the literature. 



In Tverskv and KahnemanI fl992] economic and psychological arguments are presented. 



Some authors have studied the rather specific case of continuous-time complete markets (see 
ICarassus and PhamI ll2009ll for _piecewise co ncave, and [B erkelaar et al. [2004] for S-shaped 
utility functions or I Jin and Zhou! i2008tl and ICarlier and Danal 1201 IJl. where distortions on 
the objective probability are considered) or one-period models (see ^Bernar d and Ghossoubl 
lHoiO] and He and Zhou 12011]). See also the recent paper of Reichlin |201^, in which the 
market is not complete but where the constraint on the budget set is given for one spe - 
cific given pricing measure. Note that iBerkelaar et al. 1200411 . ICarassus and Pham I 2009ll . 
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ICarlier and D anal i201lll and 'Reichlin' ['2011^ consider utility functions defined on the posi- 
tive half-line only, which leads to a considerably simpler mathematical problem. 

In the present article a general, possibly incomplete, discrete-time financial market model 
with finite horizon is considered together with a possibly non-concave utility function U de- 
fined on the real line. In our recent paper Carassus and Rasonyi 12013], we study a similar 
framework but with distortions on the objective probability. Under conditions similar to As- 
sumption l2 .41 of the present paper, a well-posedness result (i.e. the objective function is finite) 
is established but the existence of optimal strategies requires a particular structure for the 
filtration: the filtration should either be rich enough or there should exist an external source 
of randomness for the strategies. In this setup it turns out, in contrast to the usual maxi- 
mization of expected utility problem, that an investor distorting the objective probability may 
in crease her satisfaction by exp loiting randomized trading strategies. So the existence result 
of ICarassus and Rasonvil 1201311 is not pertinent in the present setting without distortions 
and, to the best of our knowledge. Theorem 12.111 Corollary 12.121 and Proposition 14.41 below 
are the first existence results for optimal portfolios maximizing expected non-concave utility 
in an incomplete discrete-time model of a financial market. 

The decisive sufficient conditions for existence are formulated below in terms of the "asymp- 
totic elasticity" of the function U at ±oo. This concep t surge d in the concave ca se, see 



Karatzas et al.l 11199111 , iKramkov and Schachermaven 11199 91 and Schachermaveii 11200111 , which 



are the earl y references. Let's denote by u(x) t he value function starting from an initial 
wealth X. In iKramkov and Schachermaveii lll999 1 it is showed, in a general semimartingale 
model, that if U (i) is strictly concave, smooth and defined on (0, +oo), (ii) is such that there 
exists X satisfying u{x) < oo and (iii) has an asymptotic elasticity at +oo, called AE+{U), 
strictly less than 1, then an optimal po rtfolio for the ut i lity m aximization problem exists. If 
U is defined over the whole real axis, Schachermaver ||2001 ^ showed existence assuming 
in addition, that the asymptotic elasticity of U at -oo, called AE^(U), is strict l y gre ater 
than 1. This condition being essentially necessary (see section 3 of lSchachermaveri ll200lll ). it 
has be en generally accepted as the standard assumption in continuous-time models, see e.g. 



Owen and Zitkovic [2009]. Note, however, that in a discrete-time setting, when U is defined 



on R, any of the two assumptions AE+{U) < 1 o r AE-(U) > 1 on its own is sufficient to 
guarantee the existence of an optimal strategy (seel Rasonvi and Stettneil ll2005ll). 

In the present study a general continuous, increasing and possibly non-concave function 
U defined on M is considered and we will assert the existence of an optimal strategy when- 
ever ^i?+(C/) < AE^{U), where AE±{U) is an appropriate extension of the asymptotic elas- 
ticity concept t o non- differentiable (and non-concave) functions. This generalizes results of 
[Rdsonyi a nd Stettneil ll2005ll . Note that some conditions ensuring well-posedness are also 
necessary to stipulate. We present easily verifiable integrability assumptions to this end. 

The key idea, as in Rasonyi and Stettner 12005], is to prove that strategies must satisfy 
certain a priori bounds in order to be optimal and then one can use compactness arguments. 
A number of measure-theoretic issues also need to be dealt with. 

The paper is organized as follows: in section[2]we introduce our setup and state our main 
result; section [3] establishes the existence of an optimal strategy for the one-step case. In 
section m we prove our main result, using dynamic programming, and provide an easily ver- 
ifiable sufficient condition for the market model that ensures well-posedness as well as the 
existence of an optimal strategy. Section [5] concludes, section [6] collects some nonstandard 
measure-theoretic facts. 



2 Problem formulation 

Let (17, S, {J^t)a<t<T, P) be a discrete-time filtered probability space with time horizon T £ N. 
We assume that the sigma-algebras occurring in this paper contain all F-zero sets. 

Let {St, < t < T} be a d-dimensional adapted process representing the (discounted) 
price of d securities in the financial market in consideration. The notation A5t :— St — St-i 

* A condition on the so-called dual optimizer is also imposed and (ii) is replaced by the existence of some x satisfy- 
ing u{x) < U (oo). 
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will often be used. If x, y e R'' then the concatenation xy stands for their scalar product. 

In what follows, will denote the set of J"* -measurable rf-dimensional random variables. 
Trading strategies are represented by d-dimensional predictable processes {(f)t)i<t<T, where 
(pl denotes the investor's holdings in asset i at time t; predictability means that 4>t £ 
The family of all predictable trading strategies is denoted by $. 

From now on the positive (resp. negative) part of some number or random variable X 
is denoted by X+ (resp. X^). We will consider quasi-integrable random variables X, i.e. 
for any sigma-field H c 5, EiX\n) will be defined by E{X\H) = E{X+\n) - E{X-\n), in 
a generalized sense, as soon as either E{X^\'H) < oo or E{X^\'H) < oo. This implies that 
E{X\7i) can possibly be infinite. In particular, EX is defined (but can be infinity) whenever 
EX^ or EX^ is finite. See section |6] for more details on generalized conditional expectations. 



Remark 2.1 Like in iRasonvi and Stettnerl ll2005ll . but in contrast to many continuous-time 



studies, we go beyond the class of (locally) bounded price processes. Therefore we will not use 
the usual "admissibility" requirements, i.e. we will allow portfolios whose value processes 
are not necessarily bounded from below. The rationality of this approach can be seen in 
the following example: assume that T = 1, d = 1, 5*0 = and ASi is a Gaussian random 
variable. Then 0i A5i is bounded from below if and only if 4>i — 0. So adding the admissibility 
requirement would seriously (and unreas onably) restrict the class of strategies to be used. 
See also section 1 of lSchachermavei] i200lll for a discussion on this subject, where it is argued 
that even in continuous-time utility maximisation problems one needs to include strategies 
with value processes that are not necessarily bounded from below. 

The value at time t of a portfolio starting from initial capital a; g R is given by 

t 

i=\ 

The following absence of arbitrage condition is standard, it is equivalent to the existence 



of a ri sk-neutral measure in discrete time markets with finite horizon, see e.g. iDalang et al. 
1 1990ll . 



(NA) IfV^''*' > a.s. for some </> e $ then F^'"^ = a.s. 

Let Dtiuj) c R'^ be the smallest affine subspace containing the support of the (regular) 
conditional distribution of ASt with respect to J^t-i, «e. P{ASt G ■\J't-i){io). It is a non-empty 
J't-i -measurable random subspace, see Proposition 14.21 below. If Dt = R*^ then, intuitively, 
there are no redundant assets. Otherwise, one may always replace (jjt G 2t-i by its orthogonal 
projection 0j on Dt without changin g the portfolio value since a.s. 4>tASt — (t>'tASt, see Remark 
iJlbelow as well as Remark 9.1 of FoUmer and S chied' f 2002ll . 



We w ill need a "quantitative" ch aracterization of (NA). From IRasonvi and Stettneii 11200511 
(see also lJacod and ShirvaevI lll998ll ). we know that 

Proposition 2.2 (NA) implies the existence of Tt -measurable random variables St,Kt > 
such that for all C e St with ^ e Dt+i a.s.: 

P{^ASt+i < -StmTt) > nt (1) 

almost surely; for all < t < T — 1. 

Remark 2.3 The "quantitative" characterization of (NA) given by ^ is only true for e -Dt+i- 
This is the reason why we will have to project the strategy ^t+i e Et onto Dt+i. We refer 
again to Remark [3l2l below. 

We now present the conditions on U which allow to assert the existence of an optimal strategy. 
The main point here is that we do not assume concavity of U. 
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Assumption 2.4 The utility function [/ : M ^ M is non-decreasing, continuous and C/(0) 



There exists x>0, a;>0, c>0, 7>0 and 7 > such that 7 < 7 and for any A > 1 



U{\x) < X~U{x) +cforx>x (2) 
U{Xx) < Xm{x) for X < -X, (3) 
Ui-x) < 0. (4) 



Remark 2.5 A typical example is given by 

U{x) = 



U+{x), X > 

-U-{-x), x<0, 

where U+{x) = a+x'^, U-{x) = a^x^ for a± > and < 7 < 7. 

Remark 2.6 In this remark, we comment on the different items of Assumption [2l4l Fixing 
U{0) = is mere convenience. If U is strictly increasing then @ clearly follows from U{0) ~ 
and x>0. 

When U is concave and differentiable, the "asymptotic elasticity" of C/ at ±00 is defined as 

U'{x)x 



AE+{U) = limsup 

a;— >oo 

AE^{U) = liminf 



U{x) 
U'{x)x 



see 



Kramkov and Schachermaver il999ll . [Schachermaveij 12001 1 and the references therein. 



Assume for a moment that c = 0. It is shown in Lemma 6.3 of Kramkov and Schachermaver 



II1999I that AE+{U) < 7 is equivalent to (Hi. Similar ly, AE_(U) > 7 is equivalent to ©. Note 



that the proof of Lemma 6.3 of Kramkov and Schac hermaven 11199 91 does not use the concav- 
ity of U. So if U is differentiable then conditions © and ® are equivalent to AE+{U) < 7 
and 7 < AE^{U), respectively. It seems reasonable to extend the definitions of AE+(U) (resp. 
AE- ([/)) to possibly non-differentiable U as the infimum (resp. supremum) of 7 (resp. 7) such 
that (HI) (resp. ([3)) holds. Doing so we may see (looking at Assumption 12.41 1 that our paper 
asserts the existence of an optimal strategy whenever there exist 7, 7 such that 

AE+{U) <^ <2< AE^{U). (5) 

The case c > is there only to handle bounded from above utility functions. In the case 
of a concave function U, it is easy to see that U{oo) < 00 implies that AEj^{U) = 0. For 
a non-concave utility function with C/(oo) < 00, the condition U{Xx) < X"'U{x) + c for all 
a; > a; > 0, holds true for any 7 > 0, so with our definition of AEj^ as an infimum of such 
7, again AE+{U) = 0. So (HJl becomes < 7 < 7 < AE^{U). Note that we could assume in 
Assumption [231 instead of (Hll, that we have either U {00) < 00, c > and 7 = or U{oo) — 00, 
c = and 7 > 0. 

So ([5) is a direct exten sion of the condition of ISchachermayer 1 200 ill , namely AE+{U) < 
1 < AE^{U). Note that iKramkov and Schachermaved lll999li requires only the condition 
A E+(U) < 1 si nce they are dealing with functions U defined on (0, 00) only. The condition 



of iRasonvi and S tettner [2005], in a discrete-time setting like ours, is either AE+{U) < 1 or 



1 < AE_{U). When U is co ncave ([2) and dUl always hold with ^ = 7 = 1, i.e. AE+(U) < 1 < 
AE^ ([/), (see Lemma 6.2 in Kramkov and Schachermaver fl999*] and ' Schachermaveij 12001 ]), 



so our paper generalizes Rasonyi and Stettner [2005] to U that is not necessarily concave. 

We finish this remark with a comment on the condition 7 < 7. It is, in some sense, minimal 
as one can see from the following example. Assume that U+{x) = x" and U-{x) = x^ with 
a > /3. Here one has that j = a and 7 = /?. Assume that Sq = 0, AS*! = ±1 with probabilities 
p,l - p for some < p < 1. Then one gets 

E{U{0 + nASi)) = pn" - (1 - p)n^ . 

If a > /3, choose p = 1/2 and E{U{nASi)) goes to 00 as n ^ 00. l{ a — (3, choose p > 1/2 and 
E{U{nASi)) = n"(2p — 1) also goes to 00 as n ^ 00. So in the case 7 > 7 the given problem 
immediately becomes ill-posed, even in this very simple example. 
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In this paper, we are dealing with maximizing the expected terminal utility EU{V^''^) 
from initial endowment x. We would like to use a dynamic programming procedure and, to 
this end, we prove that the associated random functions are well defined and finite under 
appropriate integrability conditions. 

Lemma 2.7 Assume that 

E{U-{x + y^St)\Tt-i) < +00 (6) 

a.s. holds true for aUl<t<T,xeR and y e R'^. Then the following random functions are 
well-defined for all x g M; 

Vrix) := U(x), 
Ut^i{x) := ess sup E{Ut{x + £_ASt)\Tt-i) a.s., for\<t<T 

and we have for allO <t <T and x e R: 

Ut{x) > U{x) > -00. (7) 

Moreover, for all I < t < T, x eR, S, e ^t-i, we obtain that a.s. 

E{U^{x + iASt)\Ft-i) < +00. (8) 

If we assume also that that EUo{x) < +00 then we have that for all I < t < T, x £R, ^ e 

E{Ut{x + ^ASt)\Tt-i) < Ut-i{x) < +00, (9) 
EiU+ix + (ASt)\Tt-i) < +00. (10) 

Proof Step 1: We first claim that (HJl implies 

E{U- {x + iASt)\Tt-i) < +00 (11) 
a.s. for ^ G 9t_i as well. Introduce the following vectors for each function i e W { — 1, +1}'': 

er.= {i{i)....,i{d)). 
On Ajn ■= {m - 1 < Id < fn} we have 

U-ix + S,ASt) <-aiaJiU-{x+im-l)eiASt) < ^ U- {x + {m - l)9iASt) 

hence © (with the choice y ~ {m - l)9i) implies that E{1a,„U^ (x + ^ASt)\Tt-i) < 00. Our 
claim follows by Corollarv l6.31 

Step 2: First, we note that U^{x) < +00 by (HJ) applied with y — and thus U{x) > -00. 
Now we prove by backward induction that ^ and (El) hold true and that the random function 
Ut-i is well-defined. At t = T, Ut{x) > U{x) holds trivially true and ^ holds true by ( flTl l. 
This implies, by the definition of generalized expectation, that E{U {x + £_ASt)\J^t-i) is well- 
defined for all a; e M, ^ e ^t-i, and so is Ut~-i as an essential supremum of well-defined 
random variables. 

Assume that the statements ^ hold true at < + 1, i.e. the random function Ut is well 
defined and, choosing ^ = 0, we get that, for all a; e M, 

Ut{x) > E{Ut+i{x)\Tt) > U{x) > -00, 

where the second and the third inequality holds by the induction hypothesis This implies 
also that 

E{Ut-{x + ^ASt)\Tt-i) < E{U-{x + ^ASt)\Tt-i) < +00, 

by jni l again. So E{Ut{x + i,ASt)\Ft-i), as well as Ut-i, are well-defined and statements Q, 
^ are proved. 
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Step 3: All the Ut are now well-defined by the preceding step. For a; e M and for < j < T, 

as uf{x) < U-{x) < oo by O, E{Uj{x)) < oo. Thus E{U.j{x)) is defined and by Lemma [Ol 
E{Uj{x)\J'j-i) is defined as well and 

E{U,{x)) ^ E{E{U,{x)\T,^,)). 

Let ^ e St-i, I <t <T, choosing the strategy equal to zero at the dates 1, . . . , t — 1, we get 

E{Uoix)) > E{E{Ui{x)\To)) = E{Ui{x)) >... > E{E{Ut-i{x)\Ft-2)) 

= E{Ut-i{x)) > E{E{Ut{x + ^ASt)\Tt-i))- 

As E{Uo{x)) < oo, we obtain that E{Ut^i{x)) < oo. Recalling that E{U^Li{x)) < oo, we get 
that Uf_i{x) < oo and thus Ut-i{x) < oo and (HJ) holds true. Recalling ©, ( flOl ) holds also true. 

□ 

In order to have a well-posed problem, we impose Assumption 12 . 8 1 below. 
Assumption 2.8 For all 1 < t < T, a; e M and y e R"^ we assume that 

EiU-ix + yASt)\J't-i) < +0O, (12) 
EUo{x) < +00. (13) 

Remark 2.9 In Assumption l2.8[ condition il3i is not easy to verify. We propose in Proposition 
14.41 a fairly general setup where it is satisfied, see also Corollarv l2.12[ In contrast, condition 
il2i is a straightforward integrability condition on S. For instance, if U{x) > — c(l + \x\'p) for 
some p,c> and £'|AS'f+i|P < oo then ( (121 ) holds. 

Assumption 12.81 can be written in a more convenient way for dynamic programming: see 
Lemma 12.101 below. 

Lemma 2.10 Assumvtion \2.8\ iin plies that for all J't -measurable random variables H and for 

all^ eEt,0 <t < T, 

E{U-_^^{H + ^ASt+i)\Tt) < +00 a.s., (14) 
E{U++^iH + ^ASt+i)\Tt) < +00 a.s.. (15) 

Assumvtion \2.8\ also implies that for x eM and y G 

E{U-_^^ix ~ \y\\ASt+i\)\Tt) < +oo a.s., (16) 
E{U++^ix + \y\\ASt+i\)\Tt) < +oo a.s.. (17) 

Proof AsH = Et=-ooHlHelp,p+i), applying Corollary [U with Z = U,%^iH + ^ASt+i) and 
Ap = {H e [p, j3 + 1)}, it is enough to notice that 

E{lHe[p,p+i)Ut+AH + ^ASt+i)\J't) < lHe[p.p+i}EiU-_^i{p + ^ASt+i)\Tt) < +^ a.s., 
E{lHe[p.p+i)U++,{H + ^ASt+ijlJ't) < lHe[p,p+i)E{U+^i{p+l + ^ASt+i)\J't)<+^a.s. 

by ® and 

Let a; e M and y eR'^. We get that 

U+^,(x + \y\\ASt+i\) < maxU+,,(x + \y\0,ASt+i) < ^ U+,,{x + \y\e,ASt+i) 

iew 

and ( fl5l l implies ( flTl ). Similarly, 

U,-_,,{x-y\ASt+i\)<m^U,-^,{x+\y\e.,ASt+i) < ^ C/,+i(a; + |y|0,A^t+i) 

and ( fl4l ) implies ( flGl l. □ 
We are now able to state our main result. 
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Theorem 2.11 Let U satisfy Assumvtion \2.4\ and S satisfy the (NA) condition. We also sup- 
pose that Assumvtion \2M holds true. Then there exists a "one-step optimal" strategy 4>* e $ 
satisfying, for all t = 1, . . . ,T, 

If, furthermore, EU{V^''''') exists, then 0* e and 

EU{V^'*')^ sup EU{V^'^), 

where $([/, x) is the set of strategies e $ for which E[U{V^''^)] exists and it is finite. 

We present the proof of Theorem 12.111 in section SI To demonstrate its apphcability, we 
state a simple corollary below. We will also provide a quite general setup where Theorem l2.11l 
applies and where EU{V^''^ ) can be shown to exist (see Proposition 14.41 in sectionS]). 

Corollary 2.12 Assume that (NA) holds and the utility function ?7 : M — > M is strictly in- 
creasing, continuous, bounded from above with U{0) = and satisfies ( fl2] >. Assume also that 
there exists x>0 and 7 > such that for any A > 1, U{\x) < \-U{x) for x < —x. Then there 
exists (j)* e (f>(L/, x) such that 

EU{V^'*')^ sup EU{V^'*). 

Proof. As U is bounded from above, il3i and thus Assumption 12.81 trivially holds under our 
assumptions. So do ® and (O (with, say, 7 :— 7/2, x 1 and c any positive upper bound 

for [/(oo)), hence Assumption 12.41 is true. Since U is bounded from above, E[U{V^''^ )] exists 
automatically. Now Corollarv l2.12l follows from Theorem 12. Ill □ 

Remark 2. 13 In the absence of a concavity assumption on U we cannot expect to have a 
unique optimal strategy. 

3 Existence of an optimal strategy for the one-step case 

We prove the existence of an optimal strategy in the case of a one-step model. To this aim 
we introduce (i) a function V, (ii) two cr-algebras H C T containing P-zero sets, (iii) a d- 
dimensional 7^-measurable random variable Y, and (iv) a random set D. 

Assumption 3.1 We have D e B(R'^) (8) and for almost all w, D{u}) is a non-empty vector 
subspace of R'^ which is the smallest affine subspace containing the support of P{Y e ■\'H){io). 

We will denote by S the family of 7^-measurable d-dimensional random variables. This 
setting will be applied in section |4] with the choice H — Tt-\,T ~ Ft^D ~ Dt, Y — ASu V{x) 
will be the maximal conditional expected utility from capital x if trading begins at time t, i.e. 

V = Ut. 

Remark 3.2 Let ^ G S and let j ' € S be the o rthogo nal pr ojection of ^ on D (this is V.- 
measurable by Proposition 4.6 of i Rasonvi and Stettner. Il2005ll ). Then ^ - ^' _L £> a.s. hence 
{r e L>} c {(C - £.')Y = 0}. It follows that 

P{SY = i'Y\H) = - ^')Y = OIH) > P{Y e D\'H) = 1 

a.s., by the definition of £». Hence P{iY = £,'Y) = E{P{SY = S,'Y\n)) = 1. 

We impose the following conditions on D, Y, V and Ti: 

Assumption 3.3 There exist 7^-measurable random variables a > and (3 > such that for 
all ^ G S with ^ e D a.s.: 

P{^Y <-a\^\\H)>p. (18) 
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We make the following assumptions on V. 

Assumption 3.4 Let V{uj, x) be a function from x M to M such that for almost all uj, V{uj, •) 
is a nondecreasing, finite-valued, continuous function and V{-,x) is J'-measurable for each 
fixed X. 

We also need the following integrability conditions: 
Assumption 3.5 For all x,y e R, 

E{V-{x-\y\\Y\)\n) < +00 a.s.. (19) 
Assumption 3.6 For all x,y eR, 

E{V+{x+\y\\Y\)\n) < +00 a.s.. (20) 

Remark 3. 7 Let H, ^ be arbitrary H-measurable random variables. Then, under Assumptions 
[MlandlMl E{V{H + SY)\H) exists and it is finite. Indeed, define the events A„ := {\H\ < 
m, 1^1 < m}. Clearly, on A™, V+{H + (Y) < V+{m + m\Y\) andV-{H + (Y) < V-{-m-m\Y\), 
hence by Assumptions 13.51 and 13.61 E{V^{H + ^Y)Ia^\'H) exists and is finite which implies 
our claim by Corollarv l6.31 

We finally assume the following growth conditions on V. 
Assumption 3.8 Almost surely for all x e R and A > 1, 

V{\x) < X^V{x) + CX^, (21) 
V{\x) < XlV{x) + CX2. (22) 

hold for some constants C > and 7 > 7 > 0. 

Assumption 3.9 There exists a non-negative, H-measurable random variable N such that 

P (vi-N) < -l\n] >l - P/2 a.s.. (23) 



The aim of this section is to study v{x) =v{uj,x), defined by 

v{x) ■.^esii.ii\vpE{V{x + iY)\H). (24) 

The function v{x) will represent the maximal expected utility from capital x if trading 
begins at time t — 1. Now we briefly sketch the strategy for proving the existence of an optimal 
portfolio in the one-step case. First, we prove that strategies in order to be optimal have to be 
bounded by some random variable K (Lemma lS.lOH . Then we establish that E{V{x + yY)\T-L) 
has a version G{u},x,y) which is jointly continuous in {x,y) (Lemma 13. 12D . Let A^{uj,x) = 
suPy6Qd,|y|<i<- X, y). We prove that A'^ is continuous in x and that A = v a.s, where 

A{uj, x) = supygQd G(cj, X, y) (Lemma l3.13D . Based on the preceding steps, we can construct a 
sequence ^„(w, x) taking values in D along which the supremum in the function A is attained 
and ^„ is also jointly measurable (Lemma lS.lSH . The boundedness of optimal strategies and a 
compactness argument provide a limit of ^„ (Lemma [3.16D . which turns out to be an optimal 
strategy. 

Lemma 3.10 Let Assumptions Ejl \3M 1131 1121 \EE \SM and\3Mhold. Fix xo,xi eM. with 
xq < xi. Then there exists an H-measurable random variable K = K{io, xq, xi) > such that 
for all Xq < X < xi, almost surely, we have: 

v{x)^ess. sup E{V{x + ^Y)\n). (25) 

We also have that —00 < v{x) < +00 a.s. Finally, for any H-measurable positive random 
variable I there exists a positive and H-measurable random variable N' such that v{—N') < 
-I a.s. 
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Proof. First note that 



v{uj,x)=ess. sup E{V{x + ^Y)\n){Lu), 



by Remark [3.21 So from now we assume that ^ e D. We may as well assume D ^ {0} a.s. 
since the statement of this Lemma is clear on the event {D = {0}}. 

Fix some xq < x < xi. Take ^ G S with |^| > niax(l, a;+). We will prove that there exists 
an H-measurable random variable K — K{uj, xq, xi) > such that for all xq < x < xi and for 
\S, \ > K,we have almost surely: 

E{V{x + ^Y)\n) < E{V{x)\H). (26) 

Then ( I25D follows immediately. 

As 7 < 7 it is possible to choose 77 such that < i] < I and 7 < 777. By ( l2T] l. we have the 
following estimation: 

Vix + ^Y) = V{x + ^Y)ly^,+^Y)>o + V{x + CY)lvi:,+iY)<o 

< ly(.+«y)>o {\^\~V (^^ + l^r) + C|er) + V{x + eniv(.+?r)<o 

We start with the estimation of the positive part of V. Let 

L:=E{V+{1 + \Y\)\H). (27) 

The random variable L is finite by Assumption l3.6l Thus, as V is nondecreasing (see Assump- 
tion |331), we obtain that 

For the estimation of the negative part, we introduce the event 

B := I^Vix + er) < 0, ||y < -a, V{^N) < - l| . (28) 

Then, using ( [22] l. we obtain that 

-Vix + (Y)lv(^+^Y)<o > -Vix + ^Y)lB 

> -Is (lei"^^ + ^^1^1'"") + ^1^1"-) ■ 

It is clear that B contains 

|x+ - < -N, < -a, V{-N) < - l| . 

Now, from Assumption 13.91 for all ^ G S such that ^ G a.s., we have (recalling Assumption 

p(l-^Y <-a,V{-N)<~^-l\\H) > p(vi-N) < -l\n 



+ P{V{iY <-a\£.\\'H) - I 

> P/2. (29) 

Assume that x+ - a\(\ < ~N and ||^ - ICI^^''^ < -N hold true. This is true if \^\ > Ko{x+) = 
1 

max(l,a;+, (^^—^^^ ^ " , ^-^^) (recall that < 77 < 1 and we have assumed |^| > max(l, a;+)). 
Then we have that 

E{V{x + ^Y)ly^,+^Y)<o\n) < \^rE{lBVi-N)\H) + lBC\^r^ 

< -w/2)\^r. 
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We make a little digression which will be useful when proving the existence of some non 
negative and 'H-measurable random variable N' satisfying v{—N') < —I a.s., for any H- 
measurable positive random variable /. 

Looking carefully at the estimations above, if x < and |^| > max(l, (■^) ^ " , we have 
that 

E{V{x + eF)ly(x+cy)>o|H) + Ie(V{x + ^Y)lvi,+^Y)<o\n) < (30) 

provided that 1,^1^^ + CICF - 1 1^1"- < 0. So ([30) holds true provided that \£,\^L - f l^]"! < 0, 
andCICr- f < O.i.e. 

Going back to our primary goal and putting together our estimations, for |^| > ifo(a;+) we 
have 

E{V{x + CY)\H) < \^rL + C\^p-^\(\^l. 
In order to get ( l26l ). it is enough to have 



_^\^\vi_E{V{-x-)\n) < 0. (32) 

D 

Since 7 < 777 < 7, the first two inequalities will be satisfied as soon as |^| > Ki{x+) = 

Ko{x+), (f ) , (f ) and the last one as soon as \^\ > K,{x-) = (MMZ(^£lM)l: 

So i26i is satisfied if |^| > K{x) ~ niax(iiri(a;+), K2{x^)), where K{x) is an H-measurable 
random variable. Note that K{x) is a polynomial function of ^, ^, N , \E{y {~x^)\H)Y and L. 
We conclude by setting K := vi\sx.{Kx{x'\),K2{x'^ )). 

We now show that v is finite. Let C £ |^| < K, 

- E{V-{-\x\ - K\Y\)\K) < E{V{x + SXM) < E{V+{\x\ + K\Y\)\n), (33) 

and we conclude by Assumptions l3.5l and l3.61 

Let / be a H-measurable positive random variable, it remains to show that there exists 
a positive and H-measurable random variable N' satisfying v{—N') < —I a.s. Assume for a 
moment that x < —N. Then 



> -E{li 



^ ((-¥)(^r-ar)f 

- 2 \-N 
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where we have used Assumption [3]8] (see (EUl), and the fact that /3 <1. Thus, if |^| < Ki, 
we obtain that 

E{V{x + ^Y)\n) < E{V+iKr\Ym) - ^ (^Y (34) 
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Recall the definition oi Ki (see (Ell)) and ([SOll: if |^| > Ki we get that 

E{Vix + (Y)\n) < lEily(^,+^Y)<oV{x + ^Y)\n) < (^)"- (35) 
The right-hand sides of both ( I34l > and ( I35D are smaller than — / if 

47)" > l(l + EiV+iK,\Y\)\n)). (36) 



N J - P 

We may and will assume that / > (1/2) which implies 2///3 > 1. So there exists an %- 
measurable random variable 

N' -.^ N {^(l + E{V+{ki\Y\)\H))Y (37) 

such that, as soon as a; < -N' , E{V{x + ^Y)\'H) < -I a.s. and, taking the supremum over all 
vix) < — / a.s. holds. From ( I37D . one can see that N' is a polynomial function of -g, N, I and 

E{V+{Ki\Y\)\n). □ 

Remark 3.11 Note that K{x) in the above proof depends on x only through Kq{x~^), which 
is polynomial in and [E{V{—x~)\'H)]~. Hence if V{x) > m(l + |a;|'') for some m,p > 
then K{x) depends on x in a polynomial way. Note also that K{x) is a polynomial function of 

x+,N, 1/a, 1/^, L and [EiV{-x~)\n)]- . 

Lemma 3.12 Let Assumptions 13.41 13.51 and \3.6\ hold. Then there exists a version G{u},x,y), 
{uj,x,y) en xRx R"^ ofE{V{x + yY)\n){uj) such that 

(i) for almost all u e fl, {x,y) e R x R''- ^ G(a;, x,y) £ M is continuous and nondecreasing 
in x; 

(ii) for all {x, y) e M x R^, the function lj en ^ G(a;, x,y) e M is H-measurable; 

(Hi) for each H-measurable ^, we have that a.s. E{V{x + ^Y)\'H) exists, it is finite and 

G{io,x,O^E{y{x + iY)\n). (38) 

Proof. For part (i) of Lemma 13.121 we proceed in three steps. First, we define a version of 
(g,r) -> E{V{q + rY)\'H){uj) which is uniformly continuous on any precompact set (Q)''+^ n 
[—N, NY^^. Then, in the second step, we extend this version by continuity to K'^+^ and in the 
third step we show that this extension is, in fact, a version of [x, y) -^■ E{V{x + yY)\'H). 

Step 1: Let us fix a version G(a;, g, r) ot E{V{q + rY)\n){uj) for all {q,r) G Q'^+i. Fix > 0. 
We claim that, for almost every uj, the function (q, r) ^ G{uj, q, r) is uniformly continuous on 
[~N, A^J'^+i nQ'^+i, i.e., 

P{f^ten^h) = l, (39) 

where 

Mr.= [j n {\G{qi,r,)-G{q^,r^)\<j}. 

fcGN |gi-52| + |ri-r2|<(l/fc) 

Fix ^ G N. By Assumption l3.4[ (x, y) V{x + yY) is a.s. continuous and hence a.s. uniformly 
continuous on [—N, N^^^. So there is a random variable > such that 

\V{x + yY)-V{z + wY)\<^^ (40) 

whenever (x, y), (z, w) G [-N, iV]''+^ and \x - z\ + \y — w\ < Q. 

As -V- <V <V+, we get that -V-{q - \r\\Y\) < V{q + rY) < V+{q + \r\\Y\), and from 
Assumptions 13.51 and 13.61 

e[ sup \V{q + rY)\\n] < 00 a.s. 
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Thus it is easy to see that there exists an "H -measurable t]^ such that for any event A such 
that P^AlH) < i]£ a.s., one has 



eIia sup \V{q + rY)\\n] 

V (ij.r)eQ''+in[-JV,JV]''+i / 



Then we can easily choose an 7^-measurable N-valued random variable i/je such that P{l/ilJe > 
Q\n)<m- Define the set B ^ B{qi,q2,n,r2j) := {t^ : ki - 92! + k'l - < l/M^)}- By (|40), 
definition of 77^ and ipi, we a.s. have 

lB\G{uj,qi,n)-G{uJ,q2,r2)\ < E{lB\V{qi + nY) - V{q2 + r2Y)\\n) 

< ^T:^l{(i/Vf)<cal'^ 

{(iM)>Ca sup \Viq + rY)\\n 

(q,r)eQ''+^n[-N,N]^+^ J 




This shows that for each £ eN, 



MiD[j Pi B{qi,q2,n,r2,i)a.S. 

fcfEN|gi-g2| + |ri-r2|<(l/fc) 

That is, P{UkeNr\\q,-g2\+\ri-r2\<ii/k)Biqi,q2,ri,r2,i)\Mi) =0. Fix £. In order to show 
it suffices to prove that for all w e there is k such that 

we Pi B{qi,q2,ri,r2,£). 

|gi-<?2| + |ri-r2|<(l/fe) 

Indeed, choose k := '4)i{u}), then uj e B{qi,q2,ri,r2,£) for all gi, 92, ''2 such that \qi - (72I + 
\ri - < (1/fc). This concludes step 1. 

Step 2: Clearly, there is a unique extension by continuity of G'(a;, x, y) over [-N, N^^^, for 
a.e. ijj. Thus G(a;, x, y) can be defined for all (a;, y) e ]R''+^ in a continuous way. Note that, for 

all gi,g2 eQ, y eQ^ 

G{uj,qi,y) < G{u,q2,y) 

holds on a subset of full measure and this extends to gi , 92 £ M, y e M'^ by continuity. 

Step 3: It remains to show that, for all {x,y) e R'^+^, G{u,x,y) = eIv{x + yY)\H){uj) for 
a.e. UJ. To see this, let r„) e Q''+i and (a;, y) e M'^+^ be such that r„) tends to (x, y). By 
continuity, G(a;, r„) tends to G(a;, x, y). By Assumption 13.41 V is almost surely continuous 
and V{qn + rnY{uj)){uj) goes to F(a; + yY{uj)){uj) almost surely. Moreover, there exists some 
no such that for n > no, x - 1 < g„ < x + 1 and |r„| < |j/| + 1. As by Assumption 13.41 V is 
non-decreasing, we get that 

^V-{x-l-{\y\ + l)\Y\) <V{qn+rnY)< V+ {x + 1 + {\y\ + l)\Y\). 

By Assumptions 13.51 and 13. 6[ we can apply Lemma 16.51 (conditional Lebesgue theorem) and 
conclude that G(w, g„, r„) tends to E{V{x + yY)\H): (i) is proved. 

Step 4: Assertion (ii) is straightforward, by the definition of conditional expectations. 

Step 5: As for Assertion (iii), ( [38l l is clear for constants ^. We prove dSSl l for H-measurable 
step functions = X]nynl?=!;,. next. It is clear that l^=y^G{ui,x,^) — l^=y^G{uj,x,yn) = 
E{l^=y,y{x + y„y)|H) = £;(l<;=y„V"(a; + ^Y)\n). So if we can apply Corollary [ID to W = 
G{uj, X, Z — V{x+c;Y) and An — {<; — yn}, we can conclude that G(aj, x, <;) — E{V{x+(iY)\'H). 
This Corollary does apply since E{lA„V{x + ynY)\'H) exists and it is finite bv Assumptions [331 
and [121 

Now every H-measurable random variable ^ can be uniformly approximated by a sequence 
of H-measurable step functions (<^„)„ and we can conclude using (i) and Lemma [HSl (condi- 
tional Lebesgue theorem) as before. 

□ 
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Lemma 3.13 Let Assumptions Ejl \3M 1231 1121 [M Hill and \3M hold. Define A{lu, x) = 
sup^gQd G{io, X, y) for {lo, x) £ x R. Fix some xq, xi e M. For xq < x < xi and uj e Q, 
letA^{LL!,x) :— supi^gQd |j^|<x(^ ^.j, j,^) G(aj, a;, y), where K{lu,xo, xi) is defined in Lemma \3.10\ 
Then we get that, on a set of full measure, 

(i) the function x — > A^{uj, x), x e [xq, a;i] is non-decreasing and continuous, 

(ii) v{uj, x) — A^^{u}, x) — A{u}, x) for all x G [a;o, a;i]. One even has that 

P {A{-, x) = A^{-, x) for all x e [a;o, xi]) = 1. (41) 

Remark 3.14 Considering the increasing sequence of events {A{-,x) — x) for all a; e 

[~n, n]}, ( 141] ) allow us extend A = A'"^ to R in such a way that properties (i) and (ii) continue 
to hold on M. Note that, by (ii), A is a non-decreasing and continuous version of v. We will use 
this version from now on. 

Proof. We prove (i) in two steps. First, we show that that x — > A^{io, x) is continuous. Then 
we prove that q — > A''^{ijj,q) (as well as g — > A{io,q)) are non-decreasing on Q. By step 1, 
the monotonicity argument extends by continuity to M and (i) is proved. We will work on the 
full-measure set f2 where all the conclusions of Lemma l3.12l hold. 

Step 1: Fix some a; e M such that a;o < a; < a;i and uj e Cl. Let a:„ G [a;o, a;i] be a sequence 
of real numbers converging to x. By definition of A^ , for all k, there exists some yfe(w, a:) G 
Q"^, \yk{uj,x)\ < K{u!, xo,xi) and G{u,x,yk{ijj,x)) > A^{uj,x) - 1/k. Moreover, one has that 
A^{u}, Xn) > G{uj, a;„, a;)) for all n, and by Lemma [3. 121 (i). 

liminf y4^(w,a;„) > G{'jj,x,yk{'jJ,x)) > A^{oj,x) - 1/k, 

n 

and letting k go to zero, 

liminf ^^(w,a;„) > A^{uj,x). (42) 

n 

Note that A^{ui,Xn) is defined as the supremum over a precompact set. Thus there exists 

yl{uj) G W^, |y*(a;)| < K{uj,xq,xi) and ^^(w,a;„) = G(a;, a:„, y,* (w)). By compactness, there 
exists some such that some subsequence y*^ {u j) of goes to k oo, and 

limsup„ A'^{{jj, Xn) = linife A'^{u:, a;„^). By Lemma [3.12l (i). one gets 

linisup74-'^(a;,a:„) = G(w, a:, < A^{ui,x). 

n 

Recalling ( I42D . this concludes the proof of continuity for A^ . 

Step 2: We argue w-wise again. Let qi < q2. By definition of A^, there exists some 
Vni^) G Q** satisfying G(a;, gi, > A^{uj,qi) - 1/n. Moreover, one has that A^{uj,q2) > 
G{uj,q2,yiiuj)). So, as by Lemma|3A2J(i), G{uj, q2,yU^)) > G{uj, qi,y}^{uj)),we getthat A'^ {uj, q2) > 
A^{uj,qi) — l/n. We conclude, by letting 71 go to zero, that the inequality v4^(a;, gi) < A^{uj,q2) 
holds on fi for any pairs qi < q2 of rational numbers. A similar argument provides monotonic- 
ity of A{uj, ■) on Q for a; G as well. 

Step 3: We now turn to the second part of Lemma l3.13l Fix some a; G K, we want to prove 
that, almost surely, 

sup G{uj,x,y) = ess. sup G(w,a;,^) (43) 

y&V;\y\<K{uj,xo,xi) ^(^E,\^\<K(ui,xo,xi) 

and also that the same equality holds without the bound K{uj, xo,xi). 

Once this has been established, from the definition of v, A and dSSl l we obtain 

v{x) = ess.sup E{V{x + ^Y)\'H) = ess. supG(w,i,^) = A{x). 

Using also Lemma r3.10[ ( I38D and the definition of we obtain 

= ess. sup E{V{x + ^Y)\'H) = ess. sup G{oj,x,£,) ^ A'^ {x), 

ieB.,\^\<K{uj,xa,xi) ^£E,\^\<K{uj,xo,xi) 
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as well, so (ii) holds. In order to get ( |43] ). we will show the following claim. 

Claim: Let F : x K'' — > K be a function such that for almost all w G il, F(a;, •) is continuous 
and for each y e W\ F{-, y) is H-measurable. Let K > Ohe an ?^-measurable random variable. 

Set /(w) = ess. sup^gs |^|<^(„) f (w)). Then, for almost all w, 

sup F{u,y) = f{Lo). (44) 

yGRMw|<K(c^) 



By p. 70 of lCastaing and Valadieij 1197711 . F isU® B(R'*)-measurable and so is 



sup F{u},y) = sup F{u},y). 

,\y\<K{u) yeQ'',\y\<Kiuj) 

Hence sup^^gRd |j^|<^(^) F{uj,y) > f{uj) a.s. by the definition of essential supremum. Assume 
that the inequality is strict with positive probability. Then for some e > the set 

A = {{lu, y)enxR'' : |y| < K{u:); F{u:, y) - f{Lu) > e} 

has a projection A' on Q with P{A') > 0. Recall a; ^ F{uj,^{uj)) is H-measurable for ^ e S. 
By definition of the essential supremum, / is 7{-measurable and hen ce A e 'H (g BfR*^). The 



measu rable selection theorem (see for example Proposition in.44 in iDellacherie and Mever 



il979ll ) applies and there exists some H-measurable random variable ry such that (oj, ri{uj)) e A 
for uj £ A' (and ri{uj) = on the complement of A'}. This leads to a contradiction since for all 

io e A', f{uj) < F{uj, ri{uj)) by the construction ofrj and f{io) > F{uj, rj{uj)) a.s. by the definition 
of/. 

Applying the preceding claim to F{uj,y) — G{uj,x,y) (see by Lemma l3.12l (i) and (ii)) and 
successively to K ~ K{uj, xq, xi) (recall that K is H-measurable by Lemma I3.10D and K = oo 
give us ( |43] >. 

Step 4: Our considerations so far imply that the set {A{-,q) — A''^{-,q) for all q e Q D 
[xq, Xi]} has probability one. Fix some uq in the intersection of this set with the ones where A 
is monotone and A^"^ is continuous (this intersection is again a set of full measure). For any 
X G [xq, Xi], there exist some sequences {qn)n, {rn)n C Q such that qn x and r„ \x. As A is 
non-decreasing (see step 2), A has a left and right limit in (cjq, x) : 

lim A{ujo,qn) = A{ujo,x-) and lim A(wo,9n) = A{ujo,x+). 

As A^ is continuous (see step 1), 

lim A^{ujQ,qn)^ lim A^ {LUo,q„) = A^ {ujo,x). 

So by choice of wg, A{uj,^,x-) = A{ujq, x+) — yl^(a;o, x) hence £ {A{-, x) = x) for all x e 
[xa,xi]}. Thus = for all x S [xo,a;i]) = 1. □ 

Lemma 3.15 Let Assumptions Ejl \3M 1131 EJl EJl Eil and [U hold. There is a set of 
full measure Cl and aT-L® B(R) -measurable sequence Cn(i^, x) e D such that G{lu, x, ^„(a;, x)) 
converges to A{uj, x) for all uj & Q and x eR. Moreover, for (w, x) e f] x R dehne 

En{u},x) := \G{uj,x,^niu},x)) - A{uj,x)\. (45) 

For all N > and for all uj e fl, sup|^|<^ En{oj, x) ^ 0, n ^ oo. 

Proof Choose O such that all the conclusions of Lemmata 13.121 13.13l and Remark 13.141 hold 
on this set. 

Step 1: construction of the seque nce (£.r,,)n- 

From Lemma 13.121 and a result of Castaing and Valadieij il977fl , page 70, we get that G is 



H ® B{R) (g) ;B(R'*)-measurable. Note also that A is H (g) i3(R)-measurable since A is defined as 
a countable supremum. Let qi, ... ,qk, ■■ .he an enumeration of Q''. Define D„ := {1/2"-, I e Z}. 
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Let = {(t^,a;) e nxBn : \Giuj,x,qi) - A{lj,x)\ < 1/n} and for all k > 2, define C]^ 
recursively by 

- {{io,x) eClxBn : \Giuj,x,qk)-A{u,x)\<l/n}\Ui^i_k~iCr. 

Then is in 7{ ® B{R) and, as a;) = sup^, G{u}, x, qt), one has UfeC^ = f] x D„. 

Recall from Assumption 13.11 that, for almost all w, D{uj) is a non-empty vector subspace 
of R'^ (and is thus closed). For all k, consider the projec t ion Q fc(aj) of qk on D{uj). Then 
Qfc G and, as in Proposition 4.6 of iRasonvi an d Stettner [2005], the measurable selection 
theorem (see for example Proposition III. 44 in iDellacherie and Mever [1979]) implies that 
the projection of any 7^-measurable random variable (and a fortiori of any constant) is H- 
measurable. Define for {uj,x) e f] x R 

oo oo 

C„(a;,x) = X! X! Qk{^)'^{iu:,i/2")ecj;}{^)l{i/2'-<x<{i+i)/2"}{x). (46) 

k—1 1 — — 00 

Then ^„ is H B(M)-measurable. Fix some n, / and x e [l/2'\ {I + l)/2"). Then one has a.s. on 

{uj:{u,l/2-)eC^^}, 

G{uj,x,Uu,x)) = G{Lu,x,Qk{io))=E{V{x + Qk{L^)Y)\n) 
= E{V{x + qkY)\n) = G{cj,x,qk), 

because, from Remark [3. 2 [ qkY = Q^Y a.s. As the form a partition of x D„, we have 

|G(a;, X, Cn(w, x)) — x)| < 1/n, for all n and (w, x) e O x D„. 

Step 2: Convergence results. 
Fix any integer > 0, we will prove that for all cj G il, sup|j.|<jv En{i^., x) goes to zero. We 

argue for each fixed cj g fi. As x) is continuous from Lemma r3.13[ it is uniformly contin- 
uous on [-N, N]. Hence for each e > there is > such that \A{uj, x) — A{u:, y)\ < e/2 if 
\x - y\ < r]{uj). Now let d„{x) denote the element of ID)„ such that dn{x) < x < dn{x) + (1/2"). 
We have 

|G(w,x,^„(w,x)) - A{uj,x)\ < |G'(w,x,^„(a;,x)) - G'(w, d„(x), f„(i:j, d„(x))| + 

|G(a;,d„(x),^„(tj,d„(x)) - d„(x))| + 
\A{uj,dn{x)) - A{uj,x)\ 
< + l/n + e/2<e, 

if n is chosen so large that 1/2" < ri{uj) and 1/n < e/2 both hold true. This concludes the proof 

□ 

These preparations allow us to prove the existence of an optimal strategy: 

Proposition 3.16 Let Assumvtions lSlllS^^lK^lTEllS^^lS^El andlS^Ulhold. Then there exists 
anH<Si B (R) -measurable ^{uj, x) e D such that 

v{uj,x) = E(y{x + i{uj,x)Y)\n) a.s. (47) 

Proof. Fix xq g Z. From Lemmata 13. 131 and 13.151 for all xq < x < xi := xq + 1, there exists 
a sequence ^„(w,x) g D such that G(cj, x, ^„(cj, x)) converges to v{uj,x) for all w G (recall 
that Lemma |3 . 13 1 allows us to choose a good version of w, which is equa l to A). Take K(x(], xi ) 
from Lemma [3. 101 and set CA x) := £n(x)l | ^^(^i | <y. F rom Lemma A.2 of lRasonvi and Stettnerl 
1(2005 ] (see also Lemma 2 in iKabanov and Strickerl L2001]), we find a random subsequence 
|^(a;,x) of ^'n{Lu,x) converging to some ^(w,x) for all x G [xo,xi) (on $7) as fc — > 00. Here 
-E;>fefi'(^:a;)l^(;fe),withi(/,fc) = {(cj,x) : nk{uj,x)=l} G W and 
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\Ji>kA{l, fc) = fi X M. Fix a; G K now. Define A{1, k) {w : (w, a;) G A{1 k)} e U. Then 

l>k 

Y,^Aii,k)E{V(x + £,i{x)Y)\-H) 

l>k 

X! ^A{i,k){v{(^,x) - Ei{uj,x)) 

l>k 

l^(;_fc)(u(a;,x) - sup £'„(tj,a;)) = v{ll>,x) - sup £',„(a;,x), 



> 



> 



> 



^ ^ ^ 7n>k m>k 



where ( I48D will come from Corollarv l6.3l (see the arguments below), the first inequality comes 
from Lemma FS-lOK see ( I26D ) and the second one from Lemmata l3.13l (ii) and 13 .15] (see (I45II). 

Here we applied Corollary [6l] with = T,i>k'^AiLk)EiV{x + Ci{x)Y)\n), Ai = A{l,k), 
I > k and Z = V{x + £.'k{x)Y). By Remark \3J\ E{ZIa,\'H) exists and is a.s. finite. Since 
WIai = E{ZIai \H.) a.s. holds true trivially, diSl l is satisfied. 

Note that E„i{ijj,x) -> 0, m ^ oo (see Lemma [3.151 1 also implies sup^>j. x) ^ 0, 

fc cx). As £;(V^(a; + Ifc(-^)^)l^) < ^^(^+(2; + K\Y\\'H) < 00 by Assumption l3^ the (limsup) 
Fatou Lemma applies and we obtain that 

E{V{x + i{x)Y)\'H) > limsupE{Vix + il{x)Y)\H) 

k 

> limsup(u(a;, x) — swp Em{'-^T x)) — v{uj, x). 

k m>k 

and the result is proved for x e [xo,xi). Varying xq G Z we can easily extend the construction 
to the whole of R. □ 

Proposition 3.17 Le t Assu mptions\3^ [M [131 [Ml [Ml ISl and\3Mhold. The i constructed 
in the proof of Lemma \3. 1 61 satisfies 

v{u,H) ^ E{V{H + 1{H)Y)\H) = esfi.s\vp E{V{H + SY)\'H) a.s., (49) 

for each V.-measurable M-valued random variable H. 

Proof. We will prove that the following inequalities hold true: 

v{uj, H) < E(y{H + ^{H)Y)\n) a.s. (50) 

and for any fixed ^ 

E{V (H + ^Y)\n) <v{lu,H) a..s. (51) 

Then from ^50^ and §^ applied to we get that w(a;, H) = E{V{H + i{H)Y)\n) a.s. So 

v{uj,H) = E{V{H + S,{H)Y)\H) < ess, sup^gg E{V{ H + i Y)\n) < v{uj,H) a.s. (where the last 
inequality comes from ( I51I I again) and Proposition 13 . 171 is proved. 

Step 1: It is enough to prove ( I50I I for bounded H. 
As H = J2'^=-oo Hlp<H<p+i, we want to apply Corollarv l6.3l to W — v{-,H), Ap = {p < H < 
p+l} and Z = V{H + ^{H)Y) to conclude that if ( l50l l is proved for each Hp = Hlp<H<p+i then 
it is proved for H. We only need to verify that E{V{H + S^{H)Y)lAp I'M.) exists and it is finite 
a.s., but this is clear from Remark 1 3. 7 [ 

Step 2: Proof of dSOl l for bounded H. 
First let us fix p g Z such that p < \H\ < p + 1. Let us also fix n. We will establish that 

viuj,H)-EnAuj) < E{V{H + C^{H)Y)\n) a.s. (52) 

where En^p ■= supp<^<^ En{uj,x) {E,, is defined in HSjl above) and Cn ■= Cnl|5„|<K(p,p+i) (£.n 
is defined in Lemma [3 .151 and K in Lemma r3.10D . 
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As H ^ E/=-oo ■H^l{ffe[;/2",(/+i)/2")}> applying Corollary [6]3] again, it is enough to prove 
m for J' = i?l{He[V2",(/+i)/2'.)} for each I = p2", . . . , (p + 1)2" - 1. 

Fix / e {p2", . . . , + 1)2" - 1}. Fix some step functions = Z]m>i jm^j'=j''-' converging 
to J\ k^oo, such that j.^j' e [//2", (/ + l)/2"). Then 

where the first inequality comes from Lemma [3. 101 (see 02611). the second one from Lemmata 
[333] (ii) and EH] (see So ([52) holds for each H = and, applying Corollary [131 ^ 

holds also for H = Jj.. 

By the construction of ^„ (see ([46]l), we have that ^nix) is constant for x e [1/2", (l + l)/2") 
and thus (.ni-Ji) ~ CniJ'')- So using the continuity of v on the left-hand side, the continuity 
of V and Fatou Lemma for the right-hand side, we get that 0521 * holds for each j' and the 
statement ([52) is proved. Here we can use the limsup Fatou Lemma because V{ Jl+^{ Jl)Y) < 
V^{p + 1 + K {p, p + 1)\Y\) and the latter is < oo a.s. due to Assumption l3.61 

Now we pass to the limit in ([52) along the random subsequence rik of Proposition 13.161 
(again, i52i holds for rik by Corollarv l6.3D . From Lemma r3.151 Enk,p ^ a.s. As from Proposi- 
tion l3.16l S,'n^ i^^ ^) converge to i{uj, x) for all x, ^L{lo, H{lu)) converge to |(a;, H{lo)) and using 
the same Fatou-lemma argument, we get that iSoi holds true. 

Step 3: Proof of ([51). 

Similarly as in step 1, it is enough to prove dST) for bounded H and ^. We denote by N the 
bound on |^| and by M the bound on \H\. By definition of v, dSlD holds true for constant 
H, so by Corollarv 16.31 it holds true for step functions H. Again, taking a sequence of step- 
function approximations Hi ^ H with Hi uniformly bounded, using the continuity of w for the 
the right-hand side and Fatou Lemma for the left-hand side (here it is liminf Fatou Lemma 
and we use that V{Hi + SY) > -V-{-M - N\Y\) and E{V-{-M - N\Y\)\'H) < oo due to 
Assumption [53), we get that dSD holds for all bounded H and ^ and the statement is proved. 

□ 



4 Dynamic programming 

We are now able to perform a dynamic programming argument. We need to establish that 
some crucial properties of U are true for Ut as well, i.e. they are preserved by dynamic 
programming. In particular the "asymptotic elasticity"-type conditions ( 153) and ( 154) . see 
below. 

Proposition 4.1 Assume that U satisfies Assumvtion \2.4l Then there is a constant C > 
such that for all x eR and A > 1, 

U{Xx) < X'U{x) + CX^ (53) 
U{Xx) < XlU{x) + CXl. (54) 

Proof. Let C := max{U{x), -U{-x)) + c > 0. Obviously, ( 153) holds true for a; > x by ([2). For 
< a; < X, as ?7 is nondecreasing, we get 

U{Xx) < U{Xx) < X^U{x) + c, 

from ([2) and ([53) holds true. Now, for -x < x <0, 

X~U{x) + CX~ > X~U{-x) + CX~ 

and ([53) holds true since C > -U{-x) and U{Xx) < 0. 
If X < —X, U{x) < 0. By ([3) and 7 < 7, one has 

U(Xx) < X^U{x) < X^U{x) < X^U{x) + X^C. 
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We now turn to the proof of ( l54l l. For x > 0, using ( l53] l, 7 < 7 and [/(x) > 0: 

U{Xx) < Xm{x) + CX^ < Xnj{x) + 

For -X < a; < 

XW{x) + CAT^ > Xnj{~x) + CAT^ > > f/(Ax), 
since C > x). Finally, ( [54l l for x < — x follows directly from ([Sll. □ 

Proposition 4.2 Assume that 5 satisfies the (NA) condition. Then, for all t — 1, . . . ,T, Dt 
satisfies Assumvtion \3.1[ 

Proof. By Proposition A.l of Rasonvi and Stettner I 2005ll (condition (NA) is not necessary at 
this point), Dt £ BiR"^) ig) J i and for almost all oj, Dt{uj) is an affine subspace of M''. From 
Theorem 3 of lJacod and Shirv aev [1998], under condition (NA), Dt{Lo) is, in fact, a non-empty 
vector subspace of R'^, for almost all w. □ 

Proposition 4.3 Assume that S satisfies the (NA) condition and that Assumvtions \2.4] and 
\2.8\ hold true. The functions Ut, <t <T have versions, which are almost surely nondecreas- 
ing, continuous, finite and satisfy 

Ut{Xx) < X~Ut{x)+CX~, (55) 
Ut{Xx) < XlUt{x)+CXl. (56) 

Moreover, there exist Ji-i -measurable random variables Nt^i > such that: 

P (ut{-Nt-i) < ~ llJ't-i) > 1 - Kt-i/2. (57) 



Kt-l 

Finally there exist functions ^t+i G St taking values in Dt+i, < t < T — 1 such that 

VxeM Utiuj,x)=EiUt+iix + it+iix)ASt+i)\Tt). (58) 

Proof Going backwards from T to 0, we will apply Lemmata 13.101 and 13 . 131 and Propositions 
[136] and [337] with the choice V Ut, U = Ft-i,F = Tt, D := Dt, Y := AS**. We need to 
verify that Assumptions [331 \3M 15:41 [331 \3M. ISlSl and \3M hold true. 

We start by the ones which can be verified directly for all t. The price process S satisfies 
the (NA) condition. So by Proposition 12.21 Assumption 13.31 holds true with a = 6t-i and 
/3 = Kt-i- Moreover, by Proposition l4.2[ Dt satisfies Assumption l3.11 Assumptions l3.5l and l3.6l 
follow from Assumption l2.8[ by Lemma [230l ( see (TEi and (IT)). 

It remains to prove that Assumptions 13.41 13.81 and [3.91 hold. We start at time t = T. The 
function Ut — U is continuous and non-decreasing by Assumption 12. 4[ so Assumption 13.41 
holds. Equations ( I21D and ( I22D for V = Ut follow from Proposition 14. 1[ so Assumption 13.81 
holds. Assumption l3.9l is satisfied because from (O, for any x>x, 

x^ - 



Ui^x) < j U{~x) 

and by @, U{-x) < 0: we may choose Nt-i x 

So we are able to use Proposition 13.161 and there exists a function |t with values in Dt 
such that ( [58l > holds. Moreover, by Lemmata 13.101 and 13.131 UT-ii^J,-) is a nondecreasing 
(finite-valued) continuous function hence Assumption 13 .41 holds for Ut-i- We now prove that 
and thus Assumption [3]8| hold for V — C/t-i- 

Ut-i{Xx) = E{Ut{Xx + iTiXx)AST)\TT-i) 

< X^{E{Ut{x + (|t(Ax)/A)A5t)| J"t-i) + C) 

< A^([/t-i(.t)+C), 
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where the first inequahty follows from ( I53I I for Ut- Thus ( I53I I holds for Ut-i- By the same 
argument, ( I54t also holds for Ut~i- 

It remains to show that Assumption 13.91 holds for Ut-i- Choosing It-i = 2C/kt-i + 1 in 
Lemma r3.10[ there exists some non negative and J^t-i -measurable random variable N' such 
that Ut-i{-N') < -It~i a.s. Trivially, as P{N' < n\J'T-2) goes to 1 when n — > oo, there 
exists some non-negative and JT-2-nieasurable random variable Nt-2 such that P{N' < 
Nt-2\J't-2) > 1 - Kt-2/2. Then 

P{Ut-i{-Nt-2) < -It-i\J^t-2) > P{{N' < Nt-2} n {Ut-i{-N') < -It-iWt-2) > 1 - ht-2/'2. 

We are now able to use Proposition 13.161 for Ut-i and continue the procedure of dynamic 
programming in an analogous way. □ 

Proof ofTheorem \2.11\ Set 0* :— ^1 {x) and define inductively: 



Joint measurability of assures that 0* is a predictable process with respect to the given 
filtration. Propositions 14. 3 1 and 13 . 1 7 1 show 



fort = 1,...,T. 

We will now show that if EU{V^''^ ) exists then cj)* G ^{U,x) and for any strategy (j) e 



Thus -E;[!7^_i(F^1^i )] < 00 and repeating the argument, E[U^{Vt'''''' )] < 00 for all t. 

Now let us turn to the case where EU^{V^''^ ) < 00. The same argument as above with 
negative parts instead of positive parts shows that E[Ufr{Vt^''^ )] < 00, for all t. 



By © and ([T3), -00 < U{x) < EUq{x) < 00, hence also EiUriV^'"^ )) is finite and (f)* G $(C/, x) 



Let (j) e $([/, 1'), then £'(C/(Fy ^)) exists and is finite by definition of $([/, x). By Lemma 
[6:21 we have that, for all t, E{U{V^''*')\Tt) exists and that E{E{U{V^''*')\J't)) = E{U{V^''*')). 

We prove by induction that E{U{V^''^)\Tt) < UtiVt'''^) a.s. For t ^ T, this is trivial. As- 
sume that it holds true for t + 1. By ([H and E{uf_^^{Vt''*' + (/>t+iA5t+i)| J"*) < +00 
and E{Ut+i{yf''^ + (?!)f+iA5i+i)| J'f) exists and it is finite. So, by the induction hypothesis and 
Proposition 13.171 

E{U{V^^^)\Tt) < (K"'^+0t+iA5t+i) I J-t) < £;([/,+! (y,"'^+6+i(K"^^)A5t+i) I = UtiVt^'^). 

Applying the result at i = 0, we obtain that E{U{V^''^)\Fo) < Uo{x). Using again -00 < 
U{x) < EUo{x) < 00 (see (EJl and ([l3]l), we obtain that 




EiUtiV,'^^')\Tt-i) = Ut-i{V,^J) 



(59) 





follows. 



EiUiV^^"^)) < E{Uo{x)). 



(62) 
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Putting (EUl and ([621' together, one gets exactly ^0^. □ 
We would like to check that Theorem 12.111 holds in a concrete, broad class of market 
models. Let M denote the set of M-valued random variables Y such that < oo for 

all p > 0. This family is clearly closed under addition, multiplication and taking conditional 
expectation. With a slight abuse of notation, for a d-dimensional random variable Y, we write 
Y e M when we indeed mean \ Y\ e M. 

Proposition 4.4 Let Assumption\2^hold and assume that, for all x <E R, U (x) > — m(|a;|'' + l) 
holds for some m,p > 0. Furthermore, assume that for all < t < T we have ASt G M and 
that (NA) holds with St, Kt ofProposition\T2\satisfyingl/df, l/nt € M forO <t<T-l. Then 
Assumvtion \2.8\ is satisfied and there is cp* £ ^{U, x) such that 

EU{V^'^')^ sup EU{V^^^). 

Remark 4.5 In the light of Proposition[2]2j l/St, I/k* £ M for 0<t<T — lisa certain strong 
form of no-arbitrage. Note that if either Kt or 6t is not constant, the n even a concave utility 
maximisation problem may be ill posed (see Example 3.3 in Carassus and Rasonvi [.2007i1 ). so 
an integrability assumption on l/(5f, l/nt looks reasonable. 

When S has independent increments and (NA) holds then one can choose m = k, and 
Pt — P in Proposition 12.21 with deterministic constants k, /3 > 0, and these trivially satisfy 
l/Sf , 1/Kf £ X for < i < T - 1. 

Finally, the assumption that ASt+i, I /St, I/k* g M for < t < T — 1 could be weakened 
to the existence of the iVth moment for N large enough but this would lead to complicated 
book-keeping with no essential gain in generality, which we prefer to avoid. 

Proof. We will sketch the arguments, which closely follow the proof of Proposition l4.3l Clearly, 
il2i is implied by our assumptions. Hence in order to prove that Assumption 12.81 holds true, 
it remains to check il3i . Fix {x,y) G M x R"^. We prove by induction, that the functions 
Ut, < t < T have versions, which are almost surely nondecreasing, continuous, finite and 
satisfy 

Ut{Xx) < \^Ut{x)+CX', (63) 
Ut{\x) < XlUt{x)+CXX (64) 

There exist some J"(_i-measurable random variables A^t-i > belonging to M such that: 

P{Ut{-Nt-i) < -{2C/Kt-i) - l\Tt-i) > 1 - Kt-i/2, (65) 

Finally, there exists some random variables Ct, Jt-i, Mt belonging to M, such that Ct, Mt are 
J't-measurable, Jt-i is J't-i -measurable and some numbers 9t > such that 

Ut{x) < + (66) 

E{Utix + \y\\ASt\)\Tt-i) < Jt-i{\x\~ + \y\~ + 1) < ^ (67) 
Ktix) < Mt{\xf* + 1), (68) 

where the J't -measurable random variable Kt is defined in Lemma [3. 101 for V — Ut+i and is 
a bound for \^ix)\. Note that ^ will be proved for t = 0, . . . , T - 1 while ^ and (HtJi for 
t = 0,...,T. 

Then this will imply that the Ut{x) are well defined for all x, that illi holds and that at 
time t = 0, il3i is satisfied, which will finish the proof of Proposition 14.41 To carry out this 
programme, we will refine the proof of Proposition 14.31 and, going backwards from T to 0, 
we will apply Lemmata \3A0[ [333] and Propositions \3A6[ [3T7] with the choice V -.^ Ut, H = 
Ft-i,T ^ Tt, D := Dt, Y := ASf We need to verify that Assumptions [331 \3M ISlil [331 \3M 
[131 andlUhold true. 

As before we start by the ones which can be verified directly for all t. The price process S 
satisfies (NA) condition. So by Proposition 12.21 Assumption 13.31 holds true with a — 6t-i and 
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/? = Kt-1- Moreover, by Proposition I4.2[ Dt satisfies Assumption l3.1l Assumption 13.51 follows 
from ( I12D . by Lemma [2?7]( see ^) and a proof similar to that of Lemma l2.10l 

( l68l > for t = ■ . . , T - 1 will a consequence of ([65) and (H?) for < + 1 e {1, . . . , T}. Recall 
(see Remark [3 -IIP that Kt is a polynomial function of x+, j^, ^ , Nt, [E{Ut+i{-x^)\J't]^ and 
Lf+i, where Lt+i equals L figuring in the proof of Lemma 13. 10[ for the choice V — Ut+i- By 
(El), Ut+ii-x-) > U{~x-) and [E{Ut+i{-x-)\Tt]- < E{U- {-x-)\Ft) < m{\x\P + 1) by the 
assumptions of Proposition 14.41 So Kt is a polynomial function in x. It remains to show 
that Mt is in M (it will be clear that Mt is J'i-measurable). Recall that Lt+i ~ E{U^i{l + 
|AS'f+i|)| J^t) < 3Jf by dGTl l for t + 1. So we get that Lt+i belongs to M. We have assumed that 
a nd belong to A^, so ( l68l l will be proved as soon as A^i e which is given by Assumption 
[3t9lfor V = Ut+i (and ^iort + 1). 

So it remains to prove that Assumptions l3.4[ | 3.6[|3.8l and l3.9l hold. First we look atV — Ut- 
Assumptions 13.41 and l3.8l are clear from Assumption [231 

As \x + ?/|^ < 2^{\x\"' + lyl"^), we estimate 

Uix) < ^-^U{x)+c+U{x):^Ct{\x\^+1), 

X' 

E{U{x + y|A5T|)| J-T-i) < E{Ct\Tt-i){2^\xV + 1) + 2^\yyE{CT\^STV\TT^i) 

:< Jt-i{\x\~ + \y\~ + 1) < oo. 

It is clear that Ct and Jt-i belong to M (recall ASt e M) and that Ct is -measurable 
(in fact, it is a constant here) and Jt-i is Jt_i -measurable. Thus ( l66l l and (67) hold true for 
t = T. As Assumption 13 .51 holds true, ( I67D for t = T shows that Assumption [3]6] holds true for 

t — T. Choosing Nt-i ■— x ^ ~(2'w'«jr-i)-i ^ ^ j^g^ jjj^g ^j^g proof of Proposition 14.31 we can 

see that A'^r-i e M and hence Assumption 13 .91 holds true for V = Ut (and ( |65] > for t = T). Let 
us now proceed toV = Ut-i- 

By Lemmata 13.101 and 13.131 for V ~ Ut-i, C/t-i(w,-) is a nondecreasing (finite-valued) 
continuous function hence Assumption 13 .41 holds for Ut~i- By 0251 1 

Ut-i{x) < E{Ut{\x\+Kt^i{\x\ + 1)\ASt\)\J't-i) 

< E{Ct{\\x\+KtM\x\ + 1)\ASt\\^+1)\Tt-i) 

< £;(CT(2~|a;|~+22~7^^_^(|a;r+l)|AS'Tr + l) IJ't- 
= \xp (rEiCrlJ'T-i) + 2^^K:^_,E{\ASTr\J'T-i 

+E{Ct\J't-i) + 2^'^kI_^E{Ct\AStV\Ft-i) 
:< CT-i(|a;r+l). 

As Ct-1 is Jr-i-measurable, it remains to show that Ct-i belongs to M. This holds true 
since Kt-i belongs to M by dBSl l for t = T — 1 (as mentioned before, it is a consequence of ( l65l l 
and ^7} for t = T). Furthermore, 

E{UT-i{x + \y\\AST-i\)\FT-2) < E{Ct-i\Ft-2){2^\xP + I) + 

2~\y\~E{CT-i\AST-i\~\FT-2) 
■■< Jt-2{\x\~ + \y\~ + 1) < (X,. 

As Jt-2 clearly belongs to M and Jt-2 is JT-2-nieasurable, dSTl l is proved for f = T-1. 
As Assumption 13.51 holds true, ( I67D for t = T — 1 shows that Assumption 13.61 holds true for 

t^T-1. 

Just like in the proof of Proposition I4.3[ we can show that (63^ . ( l64l ) for t = T - 1 and 
thus Assumption [3]8] hold true for V — Ut-i- It remains to establish the existence of Nt-2 G 
M, i.e. Jest for i = T - 1 and Assumption 13.91 for V ^ Ut-i- The random variable N' 
constructed in the proof of Lemma 13.101 is such that Ut-i{-N') < — /t-i, where It-i — 
(2C/kt-i) + 1. By ( l37l l, N' is a polynomial function of Nt-i (which both belong to M) 
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and £:(J7+(Xt-i|A5't|)|^t-i) which is bounded by Jt-i(0 + + 1). Hence N' belongs to 

M by ( [68l l for i = T - 1. Let us now choose 

KT-2 

The (conditional) Markov inequality implies that 

l\T-2 ^ 

As in the proof of Proposition l4.3l that 

P{Ut-x{~Nt-2) < -It-i\:Ft-2) > P({N' < Nt-2} n {Ut-i{-N') < -It-i}\J't-2) 

> P{{N' <Nt-2}\J^t-2)>1- KT-2/2. 

This finishes the proof that Assumption |2]8] is satisfied since 

EUoix) < {\x\~+l)ECo < 00. 

By \it{x) I < Mt-i{l + l^l"'-! ) hence an inductive argument shows S M and V;^'*^* G 
M for all t. By ( [69l l, one has 

EU{V^'^') < U{x)+e( ^^^^ C/(a;)+c<oo, 
hence Theorem l2. Ill applies and this finishes the proof □ 

5 Conclusions 

One may try to prove a result similar to Theorem l2.11l in continuous-time models. Theorem 
3.2 of Jin and Zhou [20081 implies, however, that taking U{x) ~ x°',x > and U (x) = -{—x)^, 
X < with < q;,/? < 1 the utility maximisation problem becomes ill-posed even in the 
simplest Black and Scholes model. On one hand, this shows that there is a fairly limited 
scope for the extension of our results to continuous-t i me ni arke t models unless the set of 
strategies is severely restricted (as in iBerkelaar et aT I 2004ll and ICarlier and Danal i201lll ). 



On the other hand, this underlines the versatility and power of discrete-time modeling. The 
advantageous properties present in the discrete-time setting do not always carry over to the 
continuous-time case which is only an idealization of the real trading mechanism. 

6 Appendix 

Let be a non-negative random variable on the probab i lity sp ace {Q, 3, P). Let H c 3 be a 
sigma-algebra. Define (as in e.g. iDellacherie and Meveij 11979(1 ). the generalized conditional 
expectation by 

E{W\n):= lim E{WAn\n), 

n— >-oo 

where the limit a.s. exists by monotonicity (but may be +oo). In particular, EW is defined 
(finite or infinite). Note that if EW < +oo, then the generalized and the usual conditional 
expectations of W coincide. 

Lemma 6.1 For all A eH and all non-negative random variables W, the following equalities 
hold a.s. 

E{lAE{W\n)) = E{WIa) (69) 

EiwiAin) ^ E{w\n)iA- (70) 

Furthermore, ElWlH) < +oo a.s. if and only if there is a sequence £ Ti, m e N such 
that E{W1a„,) < oo for all m and UmA,n = ft. In this case, E{W\'H) is the Radon-Nykodim 
derivative of the sigma-finite measure ^{A) := E{WIa), A eH with respect to P\h- 
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Proof. Most of these facts are stated in section 11.39 on page 33 of iDellacherie a nd Mevei^ 
lfl97 91. We nevertheless give a quick proof for the sake of completeness. Let A gH arbitrary. 
Then 

E{lAE{W\n)) = lim E{IaE{W An\n)) 

n— ^oo 

= \im E{{W A n)lA) = E{W1a) 

by monotone convergence and by the properties of ordinary conditional expectations. Simi- 
larly, ilOi is satisfied by monotone convergence and by the properties of ordinary conditional 
expectations. 

Now, ii Am is a sequence as in the statement of Lemma l6.1[ then fi is indeed sigma-finite 
and ( l69l l implies that E{W\'H) is the Radon-Nykodim derivative of ^ with respect to P\-u and 
as such, it is a.s. finite. 

Conversely if E{W\n) < +00 a.s. then define A,„ := {E{W\n) < m}. We have, by (HUl, 

E{WIaJ ^ E{lA,„E{W\n)) < m < 00, 

showing the existence of a suitable sequence A,n- □ 
For a real-valued random variable Z we may define, if either E{Z^\'H) < 00 a.s. or 
E{Z-\n) < 00 a.s., 

E{z\n) := E{z+\n) - E{z-\n). 

In particular, E{Z) is defined if either E{Z^) < +00 or E{Z^ ) < +00. 
Lemma 6.2 IfE{Z) is defined then so is E{Z\H) and E{Z) = E{E{Z\n)). 

Proof. We may suppose that e.g. E{Z^) < 00. Then E{Z^\'H) exists (in the ordinary sense as 
well) and is finite, so E{Z\n) exists. Then by we have E{Z^) = E{E{Z^\H)) (note that 
this last equality holds true for Z+ by the properties of ordinary conditional expectations as 
well). □ 

Corollary 6.3 Let Z he a random variable and let W be a H-measurable random variable. 
Assume that there is a sequence Am e "H, m e N such that U,„ A„j fl and E{Z1a,„ jH) exists 
and it is finite. Then 

(i) E{Z\'H) exists and it is finite. 

(ii) IfWlA„, < E{ZIaJH) a.s. for all m then W < E{Z\n) a.s. 
(Hi) IfWlA„, = E{ZlAjn) a.s. for all m then W = E{Z\H) a.s. 

This corollary applies, in particular, when E{Z\'H) is known to exist and to be finite. 

Remark 6.4 As in {ii) or (Hi) for all m, WIa^ < E{ZlAjn) a.s. and E{ZlAjn) < 00, is 
finite a.s. 



Proof. Fix some m such that E{Z1a„, |H) exists and it is finite, then E{\Z\1a^ I'M.) is also finite 
and bv Lemma lOl there exists a sequence iB^)j suchthatUjS™ = CI and E{\Z\1a,„Ibj^) < 00 
for all j. 

Then the sets C{m,j) :— Am n are such that Um.jC'{m, j) ~ fl. Let C„,7i e N be the 
enumeration of all the sets C{m,j). We clearly have E{\Z\\c„) < 00 for all n. Hence, by 
Lemma [6TT1 < 00 and thus E{Z\H) exist and are finite a.s. 

Suppose that, e.g., {W > E{Z\Ti)} on a set of positive measure. Then there is n such that 
G := C„ n {W > E{Z\H)} has positive measure. There is also m such that C„ C Am- Then 
E{\Z\Ig) < E{\Z\lcJ < 00 and 

E{E{Z\H)1g) = E{E{ZlAjn)lG)>E(WlAM^E{WlG), 

but this contradicts the choice of G, showing W < E{Z\'H). Arguing similarly for {W < 
£;(Z|?^)} we can get (iii) as well. □ 

Lemma 6.5 Let Z„ be a sequence of random variables with \Zn\ < W , n € N converging to Z 
a.s. IfE{W\n) < 00 a.s. thenE{Zn\H) ^ E{Z\H) a.s. 
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Proof. Let Am e "H be a partition of such that E{W1a,„) < oo for all m. Fixing m, the 
statement follows on A,n by the ordinary conditional Lebesgue theorem. Thus it holds on the 
whole of since the A,n form a partition. □ 

Proposition 6.6 Let 5 : M — > R+ be convex and let E{Z\H) exist and be finite. Then 

Eig{Z)\H) > g{E{Z\n)) a.s. 

Proof We may and will assume g{0) = 0. Define B := {E{g{Z)\'H) < 00}. The inequality is 
trivial on the complement of B. 

From Lemma lOl let A,„ be a sequence such that U,„Am — D, and E{\Z\1a^) < 00, 
E{g{Z)lA,„ Is) < 00 hold for all m. From the ordinary Jensen inequality we clearly have 

lBE{g{Z)lAjn) = E{giZlA^lB)\n) > g{E{ZlA„lB\n)) - g{E{Z\n))lA„AB 

for all TO, and the statement follows if we can apply Corollarv l6.3[ i.e. if E{g{Z)lA,„ jH) exists 
and it is finite a.s. This holds true by the choice of A™. □ 
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